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Abstract 

It is well known that if the power spectral density of a continuous time stationary stochastic pro- 
cess does not have a compact support, data sampled from that process at any uniform sampling rate 
leads to biased and inconsistent spectrum estimators. In a recent paper, the authors showed that 
the smoothed periodogram estimator can be consistent, if the sampling interval is allowed to shrink 
to zero at a suitable rate as the sample size goes to infinity. In this paper, this 'shrinking asymp- 
totics' approach is used to obtain the limiting distribution of the smoothed periodogram estimator of 
spectra and cross-spectra. It is shown that, under suitable conditions, the scaling that ensures weak 
convergence of the estimator to a limiting normal random vector can range from cube-root of the 
sample size to square-root of the sample size, depending on the strength of the assumption made. 
The results are used to construct asymptotic confidence intervals for spectra and cross spectra. It 
is shown through a Monte-Carlo simulation study that these intervals have appropriate empirical 
coverage probabilities at moderate sample sizes. 

Keywords: Power spectral density, spectrum estimation, smoothed periodogram, shrinking asymp- 
totics, asymptotic confidence interval. 

1 Introduction 

Estimation of power spectral density (spectrum) of a continuous time, mean square continuous, 
stationary stochastic process is a classical problem. Generally the estimation is based on finitely 
many samples of the process. It is well known that if the spectrum is compactly supported (ban- 
dlimited), then it can be estimated from uniformly spaced samples, provided the sampling is done 
at the Nyquist rate or faster (Kay, 1999). For sampled non-bandlimited processes, or bandlimited 
processes sampled at sub-Nyquist rate, the problem of aliasing leads to biased estimation. For this 
reason, it is sometimes argued that a non-bandlimited spectrum can never be estimated consistently 
from uniformly spaced samples at any fixed sampling rate (Shapiro and Silverman, 1960; Masry, 
1978). 

Consequently, some researchers have turned to non-uniform sampling schemes such as stochas- 
tic sampling and periodic non-uniform sampling. Masry (1978) proved the consistency of some 
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spectrum estimators based on stochastic sampling schemes, under appropriate conditions that al- 
low the underlying spectrum to be non-bandlimited. For bandlimited processes, it has been shown 
that periodic non-uniform sampling at sub-Nyquist average rate can lead to consistent spectrum 
estimation (Marvasti, 2001). 

It is important to note that the argument of inconsistency of spectrum estimators computed from 
uniformly spaced samples is based on the assumption that the sampling rate remains fixed even 
as the sample size goes to infinity. However, when one has the resources to increase the sample 
size indefinitely, one would like to use some of those resources to sample faster, rather than being 
constrained by a fixed sampling rate. In fact, it has been shown (Srivastava and Sengupta, 2010) that 
if this constraint is removed, and the sampling rate is allowed to increase suitably as the sample size 
goes to infinity, then the smoothed periodogram can be a consistent estimator of a non-bandlimited 
spectral density. 

It should be noted that uniform sampling is generally far easier to implement than non-uniform 
sampling. For this reason, the fact of consistency of a spectrum estimator computed from uniformly 
spaced samples of a non-bandlimited process is noteworthy. This fact also gives rise to further 
questions about the estimator, such as its convergence in distribution, and construction of asymptotic 
confidence intervals for the spectrum, based on the estimator. These questions have so far not been 
addressed through asymptotic calculations that allow the sampling rate to go to infinity. This is what 
we propose to do in this paper. 

The asymptotic approach chosen here (referred to as 'shrinking asymptotics' by Fuentes, 2002) 
was also adopted by other authors (e.g., Constantine and Hall, 1994; Hall et al, 1994; Lahiri, 1999), 
although the asymptotic distribution of the smoothed periodogram has not been studied previously. 
This approach is different from the 'fixed-domain asymptotics' or 'infill asymptotics' approach 
(Chen et al., 2000; Stein, 1995; Zhang and Zimmerman, 2005; Lim and Stein, 2008) which, in the 
present case, would have required that the time-span of the original continuous-time data (before 
sampling) remains fixed as the sampling rate goes to infinity. 

Let X = {X(i), — oo < t < oo} be a vector-valued mean square continuous stationary 
stochastic process, having zero mean. We denote the components of the process X by l n = 
{X a (t), — oo < t < oo} for a G {1, 2, ... , r}, and the variance-covariance matrix of the process 
X at lag r by 

( Cn(r) C 12 (r) ... C lr (r) N 

<?2i(r) C 22 (r) ... C 2r (r) 
C ( r ) = . 

^ CVi(t) C r2 (r) ... C rr (r) J 
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where 

C aia2 {r) = E [X ai (t + r)X a2 (t)] for a u a 2 E {1, 2, . . . , r}. 
The spectral and cross-spectral density matrix of the process X is denoted by 

<M0 ••• <M0 N 

022(0 ••• 02r(O 
0r2(O ••• 0rr(O / 

where 

i r 00 

0aia 2 (A) = — / C aia2 (t)e~ ttx dt for - oo < A < oo, ai,a 2 E {1,2,... ,r}. 
In this paper, we consider the following estimator of 4> ai a 2 (A) f° r «i > a 2 E {1, 2, . . . , r}: 

^ (A) = E E *(&»(ti-fc))*«i ^ 2 e- ii£l ^l [ _ wpni7rpn] (A), (1) 

where i^(0 is a covariance averaging kernel, 6„ is the kernel bandwidth, p n is the sampling rate and 
1a (A) is the indicator of the event A E A. 

In Section 2, we establish the consistency of the spectrum estimator (Q]) for non-bandlimited 
processes, which is a generalization of a result of Srivastava and Sengupta (2010) to the case of 
multivariate time series. It paves the way for our main result on the asymptotic distribution of the 
estimator, given in Section 3. Section 4 contains some discussion on optimal rates of convergence. 
In Section 5, we investigate the question as to how large the sample size should be in order for 
the applicability of the asymptotic distribution and the resulting pointwise confidence intervals. We 
look for answers through a Monte Carlo simulation study and report the findings. All the proofs are 
given in the appendix. 

2 Consistency 

In order to establish the consistency of the estimator 4> ai a2 (0 gi yen i n CQ>> we make a few assump- 
tions on the process X, the kernel K(-) and the sequences b n and p n . 

Assumption 1. The function g ai a 2 (-), defined over the real line as g ai a 2 {t) = su P| s |>|t| \C ai a 2 ( s )\ 
is integrable for all ax, a 2 €{1,2,..., r}. 

ASSUMPTION 2. The covariance averaging kernel function K(-) is continuous, even, square 
integrable and bounded by a non-negative, even and integrable function having a unique maximum 
at 0. Further, K(0) = 1. 



*(•) 



i>2i( 



\ 0rl(O 
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Assumption 3. The kernel window width is such that nb n — > oo as n — > oo. 
Assumption 4. The sampling rate is such that p n — > oo and p n b n — > as n — > oo. 
Note that Assumption 4 implies that b n — > as n — > oo. 

Theorem 1 . Under Assumptions 1-4, the bias of the estimator <p ai a 2 (") tends to zero uniformly 
over any closed and finite interval. 

In order to establish convergence of the variance-covariance matrix, we need a further as- 
sumption involving cumulants. Recall that the r-th order joint cumulant of the random variable 
(Yi,...,y r )is given by 

cum(Y 1 , ...,Y r ) = 2(-l) P " 1 (P " !) ! ( E II Yj I x " " " x ( E II Y i I . ( 2 ) 

where the summation is over all partitions u = (z/i, . . . , v p ) of size p = 1, . . . , r, of the index set 
{l,2,...,r}. 



Assumption 5. The fourth moment E 1 
fourth order cumulant function defined by 



{X aj (t)) 4 is finite for all cij G {1, . . . , r}, while the 



cum [X ai {t + h),X a2 (t + t 2 ), X a . A (t + t 3 ), X ai (t)} 

does not depend on t, and this function, denoted by C aia2a3a4 (ti, t2, £3), satisfies 

3 

\C ai (12CLZCLA 

1=1 

where g ai (ti), i = 1, 2, 3, are all continuous, even, nonnegative and integrable functions over the 
real line, which are non-increasing over [0, 00) for all a±, 02, 03, 04 G {1, 2, ... , r}. 

Note that the cross spectral density is, in general, complex valued. Thus, the proposed estimator 
4>a 1 a 2 (") can be represented as the vector 

( Re(j aia2 (\)) \ 
/m^ aia2 (A)J J 
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where 

ReQ ai a 2 {X)) 



kM K{bnih - ti))x - (£) x - (£) cos (^) i[ — i(A) ' 



'Ittii [>,, ti=ih 
Im($ aia2 (X)) 



27rnp r( 

Theorem 2. Under Assumptions 1-5, the covariance of 

converges as follows: 

Re (4> aia2 (\ijj \ I Re (^0304(^2)) 
(0 olO2 (Ai)) I Um^ a3a4 (A 2 )j 



si" I ) l^ n ,^ n] (A). 



lim nb n Cov 

n— >oo 



i?e ft aia2 (-)) \ I Re (4> a3 a 4 (-)) 

)~ \ with )~ 

Im ^0102 (OJ y y™- (0a 3 a 4 (O 



o"n(Ai,A 2 ) o"i 2 (Ai,A 2 ) 

C2l(Al,A 2 ) CT 22 (Ai,A 2 ) 



where 



o-n(Ai,A 2 ) = B ■ Re {0* ia3 (A 2 )0 a2O4 (A 2 ) + 0* ia4 (A 2 )</>a 2 a 3 (A 2 )} 

x[l £2 (Ai,A 2 ) + l jB3 (Ai,A 2 ) + 2 x l E4 (Ai,A 2 )], 
^i 2 (Ai,A 2 ) = -B-/m{0 aia3 (A 2 )0* 2a4 (A 2 ) + 0* ia4 (A 2 )0 a2a3 (A 2 )} 

x[l B2 (Ai, A 2 ) + 1e 3 (Ai,A 2 )], 
^2i(Ai,A 2 ) = 5-/m{0* ia3 (A 2 )(/> a2a4 (A 2 ) + 0* ia4 (A 2 )^ a2a3 (A 2 )} 
x[l £2 (Ai,A 2 ) - 1e 3 (Ai,A 2 )], 
B ■ Re {0 aia3 (A 2 )C 2 a 4 (A 2 ) - ^ 1 a 4 (A2)C 2a3 (A 2 )} 



a 22 (Ai, A 2 ) 

B 
Ei 
E2 
E3 



x[l B2 (Ai, A 2 ) - l E3 (Ai,A 2 )], 



1 



K 2 (x)dx, 



{(Ai, A 2 ) : Ai - A 2 / 0, Ai + A 2 / 0, - 00 < Ai, A 2 < 00}, 
{(Ai, A 2 ) : Ai - A 2 = 0, - 00 < Ai, A 2 < 00} \ {(0, 0)}, 
{(Ai, A 2 ) : Ai + A 2 = 0, - 00 < Ai, A 2 < 00} \ {(0, 0)}, 



Ea = {(0,0)}. 



The convergence is uniform over any compact subset of E\, E2 or E3. In particular, the variance- 

' ReU aia2 (-)) 

I goes to zero as n — > 00, for all 



covariance matrix of the random vector 
ai,a 2 G {1,2, ...,r}. 
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The covariance between two complex-valued random variables is often defined as the trace of 
the 2x2 cross-covariance matrix of the random vectors formed by their real and imaginary parts 
(Brockwell and Davis, 1991). In the case of the pair (4> aiCl2 (\i), O3 a 4 (A2)), the limiting covariance 
according to this notion can be easily be computed from Theorem 2. 

Theorem 1 and Theorem 2 together establish the consistency of any vector of estimators having 
elements of the form 4> aia2 (•). 



3 Asymptotic Normality 

We will make an additional assumption about the underlying process in order to prove the asymp- 
totic normality of the estimator. 



E 



Assumption 5A. The process X is strictly stationary; all moments of the process exist, i.e., 
(X a (t)) k < oo for each k > 2 and for all a G {!,..., r}; and for each a\, a 2 , ■ ■ ■ , £ 



{1,2,..., r} and each k > 2, the kth order joint cumulant denoted by 

C ai a,2...a k (tli • • • j tk-l) = CUTfl (X ai (h +t),X a2 {t 2 + t),..., x ak-1 (t fe _! + t),X ak (t)) , 
satisfies 

fc-i 

\C a 

i=l 

where g ai (tj), i = 1, . . . , k — 1 are continuous, even, nonnegative and integrable functions over the 
real line, which are non-increasing over (0, oo). 

Note that Assumption 5A is stronger than Assumption 5. 

The following theorem describes the asymptotic behaviour of the joint cumulants of the estima- 
tors 4 , a 1 a 2 (') f° r °ii °2 £ {1)2,..., r}. In the present case, a cumulant defined as in © may be 
complex-valued. 

THEOREM 3. Under the Assumptions 1-4 and 5 A, for L > 2, the Lth order joint cumulant 
of the vector [4> ai a 2 {Xi), . . . , 0o2i-ia 8I , (Al) ) for a\, a 2 , . . . , a 2 L € {1, 2, . . . , r} is bounded from 



above as follows. 

cum (^0x02 (Ai), • • • )0o 2 £-ia 2 i(Ai)) < Q ■ (n6„) _(L_1) , (4) 
where the constant Q does not depend on X±, . . . , \l- 
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THEOREM 4. Under Assumptions 1-4 and 5A, a vector of real and imaginary parts of estimated 
spectra or cross-spectra converges weakly as follows. 



nb r 



( /te{£ oia2 (Ai)} \ 
Im{<f) aia2 (Xi)} 

- Re {^a 2J _ 1 a 2J (Aj)} 
V ^"»{^02J-l02j(Aj)} J 



E 



( i?e{0 aia2 (A!)} \ 
Im{<f> ai a 2 (Xi)} 

Re{4> a2J _ ia2J {\j)} 

V /m {^a 2J _ ia2J (Aj)} J 



D 



iV 2J (0,S), (5) 



where a±, a 2 , ■ ■ ■ , a 2 j G {1,2,..., r}, a«<i ?/ze elements ofT, are defined in accordance with Theo- 
rem 2. 



The foregoing theorem only shows that the vector estimator, after appropriate mean adjustment 
and scaling, converges weakly to a multivariate normal distribution. However, weak convergence 
around the true vector of spectra and cross-spectra remains to be established. Note that 



f nb^ l (j) ai a 2 (A) - 4> ai a 2 (A)) = \fnK {^ ai a 2 (A) - E\^ ai a 2 (A)]) 

+ ^fnh n (E[4> (A)]- H J aia 2 (A) 



(6) 



We make some further assumptions on the smoothness and the rate of decay of the spectrum and 
the shape of the kernel function in order to obtain the rate of convergence of the bias E[(f> aia2 (A)] — 

0oia 2 (A). 

Assumption 1A. The function g qai a 2 (-), defined over the real line as 

9qaia 2 {t) = SUp | s\ q \ C aiCl2 (s) | 

M>l*l 

is integrable for all oi, a 2 G {1, 2, . . . , r}, for some positive number q greater than 1. 

Assumption IB. The power spectral density is such that, for all a\, a 2 G {1,2, ... ,r} and for 
some p > 1, lim \X p (f) aia2 (A)| = A aia2 for some non-negative number A aia2 . 

A^oo 



For any kernel K(-), let us define 



k s = lim 



1 - K(x) 



x^fO \x\ 



for each positive number s such that the limit exists. The characteristic exponent of the kernel is 
defined as the largest number s, such that the limit exists and is non-zero (Parzen, 1957). In other 
words, the characteristic exponent is the number s such that 1 — K(l/y) is 0(y~ s ). 
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ASSUMPTION 2A. The characteristic exponent of the kernel K (•) is a number, for which As- 
sumption 1A holds. 



Note that Assumption 1A implies Assumption 1, and also that (f> ai a 2 (") is [l] times differentiable, 
where [q] is the integer part of q. Thus, the number q indicates the degree of smoothness of the 
spectral density. If Assumption 1A holds for a particular value of q, then it would also hold for 
smaller values. 

The number p indicates the slowest rate of decay of the various elements of the power spectral 
density matrix. The following are two interesting situations, where Assumption IB holds. 

1. The real and imaginary parts of the components of the power spectral density matrix are 
rational functions of the form 0xy, where P(-) and Q(-) are polynomials such that the degree 
of Q(-) is more than degree of P(-) by at least p. Note that continuous time ARMA processes 
possess rational power spectral density. 

2. The function C aia2 {-) has the following smoothness property: C aia2 (-) is p times differen- 
tiable and the p th derivative of C aiCL2 (•) is in L 1 . 



THEOREM 5. Under Assumptions 2^4, 1A, IB and 2A, the bias of the estimator 4> a ia 2 W given 
by U$,for ai,a 2 G {1,2,... ,r}, is 



E[(f>aia 2 (X) ~ 0aia 2 (A)] 



\t\iC aia2 (t)e- ux dt 



+ 



+ 



"2tt 

~ / \l\("'n^(lV- llX <1l 



oo 

'OO 



( Pn b n ) q + o(( Pn b n ) q ) 



Pn 



— ) + o[ — 

n 



Pn 



n 



A, 



1«2 \ " _J_ 

W \P |7|f 



(2vr)P ^ \l\P 
y ' |/|>o 1 1 



1 / 1 

+ o 



(Pn) p \(Pn) P 



Theorem 5 shows that the second term in © would go to zero if the sampling rate p n satisfies 
additional conditions. 

Assumption 4A. The sampling rate is such that \Jnb n (p n b n ) q — > and \Jnb n j fp n — > as 
n — > oo. 

Note that, whenever Assumption 3 holds, Assumption 4A is stronger than Assumption 4. With 
this assumption, the expected values of the estimators in Theorem 4 can be replaced by the respec- 
tive true values. 
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THEOREM 6. Under Assumptions 1-3, 1A, IB, 2 A, 4A and 5 A, we have the following weak 
convergence. 



'nbr 



( i?e{0 aia2 (A!)} \ 
Im{4> aia2 (Xi)} 

Re{4> a2J _ ia2J {\j)} 

(Aj)} J 



( Re{<f> aia2 (\ x )} \ 
Im{4> aia2 {\i)} 

-Re{0 a2J _ ia2J (Aj)} 

V Im {<Pa 2J ^a 2 .,{^j)} ) 



D 



JV2j(0,£), 



where a\, 02, • • • , &2J £ {1 ; 2, . . . , r}, ant/ ?/ze elements ofT, are defined in accordance with Theo- 
rem 2. 



4 Optimal rate of convergence 

We are now in a position to optimize the rates of b n and p n so that -^7=5= tends to as fast as possible 
under the conditions of Theorem 6. 

THEOREM 7. Under Assumptions 3 and 4 A, the reciprocal of the scale factor (-^==) used in 
Theorem 6 has the fastest convergence to when 

/ p+i \ 
b n = o in p+i+2pq J 5 



1 



p n = O ynp+i+ 2 Pi 

1 / pi \ 

and under these conditions, —7= = o In p+i+ 2 pi \. 

\Jnb n \ ) 

It has been shown in Srivastava and Sengupta (2010) that under the assumptions of Theorems 2 
and 5, the optimal rate of convergence for mean square consistency of the estimator (Q} is given as 



E 



{0« xaa (O - <Pa ia2 (-)} 2 ] =0(n p+ 2 /+2p^ 



which corresponds to the choices 

/ p+q \ 

b n = 1 n p+i+2 P q J ; 

p n = O ^nP+i+ 2 Pi^ . 

Theorem 7 shows that the optimal rate of weak convergence of the estimator (f> ai a 2 (") i s slower than 
the square root of the optimal rate corresponding to mean square consistency. 

It is important to note that for every fixed value of q, the number p, which indicates rate of decay 
of the spectrum, can be increased indefinitely by continuous time low pass filtering with a cut off 
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frequency larger than the maximum frequency of interest. There are well-known filters such as the 
Butterworth filter, which have polynomial rate of decay of the transfer function with specified degree 
of the polynomial, that can be used for this purpose. For fixed q, the best rate of weak convergence 
given in Theorem 7, obtained by allowing p to go to infinity, happens to be o i^n 1 + 2< ?^. 

The rate of weak convergence crucially depends on the number q, the assumed degree of 
smoothness of the spectrum. The stronger the assumption, the faster is the rate of convergence. 
The rate corresponding to q = 1 (weakest possible assumption) is o (rT 3 ^ , assuming that p can be 
allowed to be very large. For very large q (very strong assumption) and large p, the rate approaches 



5 Simulation 

With a view to investigating the applicability of the asymptotic results reported in Section 3 to finite 
sample size, we consider the bivariate continuous time linear process 

' X 1 {t) \ I ft^ h ± {t - u)Z 1 (u)du + fi^ h 2 {t - u)Z 2 {u)du ^ 

\ X 2 (t) ) \ ft^ h 3 (t - u)Zi(u)d« + h A {t - u)Z 3 (u)du j 

where Zj(u), j = 1, 2, 3 are independent continuous time white noise and hj(u) = f3je~ ajU for 
j G {1, 2, 3, 4}. The elements of the spectral density matrix 

MA) 012(A) 

012(A) 22 (A) 



are defined as follows (Hoel et al., 1972). 



Pi , 1 Pi 



MX) ~ 2^'^TV + 2n a 2 + A 2 ' 
6 (X) 1 % l 1 01 



#e(MA)) 
and /m(0i 2 (A)) 



2vr al + X 2 2vr a\ + A 2 ' 
J_ /?i/3 3 («i«3 + A 2 ) 
2vr ' ( a 2 + A 2 )(a 2 + A 2 ) 

J_ AftK - «i)A 
2vr ' ( a 2 + A 2 )(a 2 + A 2 )' 



We simulate this bivariate process with the choices j3\ = 1, f3 2 = 1, /?3 = 2, fa = |, a± = Pi ■ \J §, 
ot 2 = (3 2 ■ \/3, 03 = fa • y/S and 0:4 = fa • a/3- Note that for this process, Assumption 1A holds 
with q > 1 and Assumption IB holds with p < 2. For the purpose of estimation, we make these 
assumptions with p = 2 and q = 2. In accordance with this choice of g, we use the second order 
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kernel function 

1 — i I 

We also use the rates b n = |n * and p n = 4 • n& . 

We estimate the bivariate spectrum matrix for frequencies in the range [0, 37r] at intervals of 
.0l7r (i.e., 301 uniformly spaced grid points). We subsequently compute the normalized statistics 

0n(A)- 0ii (A) 




2{1 + 1 {O} (A)}B0? 1 (A) < 

022(A) - 022(A) 



^2{l + l {o} (A)}i?0| 2 (A) / 

fie(0 12 (A))-i?e(0 12 (A)) 

{1 + 1 {O} (A)} J B[0 11 (A)0 22 (A) + {i?e(0 12 (A))}2 - {/m(0 12 (A))P] 

/m(0i 2 (A)) - /m(0 12 (A)) 



^/5[0n(A)0 22 (A) - {i?e(0 12 (A))}2 + {/m(0 12 (A))}2] 



[1-1 {0 }(A)], 



in accordance with Theorem 2. According to Theorem 6, the asymptotic distribution of each of 
these four statistics is standard normal. This procedure is repeated for 500 simulation runs. By 
regrading the values of the above statistics for the different simulation runs as four data sets of size 
500 each, we calculate the Kolmogorov-Smirnov test statistic (Shorak and Wellner, 1986) for these 
data sets, and the corresponding p-value. This procedure is repeated for the 301 frequency values 
mentioned above. The percentage of p- values (across 301 frequency values) exceeding the number 
0.05 are reported in Table 1, for sample sizes n = 100, 1000, 10000 and 100000. The table shows 
that for each statistic, the percentage approaches the ideal value of 95 very slowly as n increases. 

We now turn to computation of confidence limits of the power spectral density. For each 
frequency value, we compute the 95% asymptotic confidence intervals of 0n, 22 , i?e(0i 2 ) and 
/m(0i 2 ) from the statistics Ti(A), T 2 (A), Ts(X) and T^A), assuming that the latter have the stan- 
dard normal distribution. Subsequently, we compute the fraction of times (out of 500 simulation 
runs) the confidence limits capture the true value of the function. These percentages are plotted 
against the frequency, for sample sizes n = 100, 1000, 10000 and 100000, in Figure 1. It is seen 
that the observed fraction approaches the ideal coverage probability (0.95) for larger sample sizes. 
Since there is a discontinuity of the asymptotic variance function at the point A = 0, while the esti- 
mated spectrum is constrained to be continuous, some anomalous behaviour in the neighbourhood 
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sample 


observed percentage 


size (n) 


0n 


022 


Re(<hs) 


im(0i 2 ) 


100 


0.0% 


0.0% 


0.0% 


0.0% 


1000 


4.3 % 


6.0% 


9.6% 


16.3 % 


10000 


73.4 % 


72.4 % 


76.1 % 


72.8 % 


100000 


91 A % 


88.4 % 


93.4 % 


90.0 % 



Table 1 . Observed percentage of frequencies (in the range to 37r) for which p-values of the Kolmogorov- 
Smirnov statistics for testing normality of <f>n, 022, i?e(0i2) and 7ro(0i2) are greater than 0.05 (ideal per- 
centage is 95%). 
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Figure 1. Empirical coverage probability (based on 500 simulation runs) of pointwise confidence intervals of 
0n, 022, Re(<f> 12 ) and Im(cf) 12 ) for sample sizes 100, 1000, 10000 and 100000. 

of the the point A = is expected. This results in substantially lower values of the empirical 
coverage probability in this region. However, this region of anomaly is observed to shrink as the 
sample size increases. It would be interesting to note that the empirical coverage probability is 
reasonably close to the ideal coverage probability for most frequency values when the sample size 
as small as 1000, even though Table 1 indicates that the asymptotic distribution is not applicable at 
this sample size. 
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Appendix 

We denote by K\ (•) a function that bounds the covariance averaging kernel K (•) as in Assumption 2. 
Further, we denote -Ki(O) by M. 

Proof of Theorem 1. We shall show that the bias of the estimator 4> aia2 (X) given by © 
converges to uniformly over [Aj, X u ] for any A;, X u such that A; < X u . Note that 

n-1 

-np n ,np„\ 



^ 1 v — v / \u\ \ ( U \ iah 

E[(t>a,a 2 {\)] = -z 2^ 1 K(b n u)C aia2 — e p» l f _ wPni7rPnl (A). 

^ n u =-(n-l) V Pn/ V/W 



Consider the simple function S n (-), defined over [A;, X u ] x K, by 

i v— i / \ u \\ ( u \ iuX 

S n (X,x) = — 2^ 1 \ K(b n u)C aia2 I— e p» Ih^it^jWI/W (x). 

Z7r n= _^ n _ 1 j V / VP"/ V Pi 'PnJ 

Observe that S n (X, x)dx = E[(f) aia2 (A)]. Define the function S'(-), over [A/,A U ] x M, by 
S(X,x) = ±C aia2 (x)e- ixX . 

For any x G M, let u n {x) be the smallest integer greater than or equal to p n x. Note that the 
interval ( «s=iM 



u„(x) 

have from Assumptions 3 and 4, 



contains the point x and lim n _ s>00 H^W = x for sufficiently large n, we 



S n (X, X )=-^--^-)K^b nPn —)C aia2 ^—)e *. 1[- WP „](A). 

Proving the uniform convergence of Bias[4> aia2 (X)] over the finite interval [Aj, A u ] amounts to 
proving 

/OO /'OO 
S n (X,x)dx = / S(A,x)<ix, (A.l) 
-OO J — OO 

uniformly over [Aj, A M ]. 

Observe that 5(A, t)dt = ai(I2 (A), which is continuous. By virtue of the continuity of the 
limiting function, (IA. lb is equivalent to proving that f_ S n (X, x)dx converges continuously over 
this interval (Resnick, 1987), i.e., for any sequence X n — > A, 

^oo /*oo 

lim / S n (X n ,x)dx= / S(X,x)dx, (A.2) 



where A n , A G [A/, A u ]. 

By continuity of the function 5 n (A, x) with respect to x and A, we have from Assumptions 3 
and 4, for any fixed x, 

lim \S n (X n ,x) - 5(A,x)| = 0. 
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Note that from Assumptions 1 and 2, we have the dominance 



\S n (\n,x)\ <M 

\u\<n 



(1-2 



u 



U— 1 U 

. Pn ' pn 



(x) < Mg aia2 {x) 



where g ai a 2 (") i s the function described in Assumption 1. Thus, by applying the dominated conver- 
gence theorem (DCT), we have (IA.2b . 

Hence, E[(j) aia2 (X)] — > (p(X) uniformly on [A/, A u ]. □ 

Proof of Theorem 2. We begin by calculating the covariance between the estimators -Re(f/> aia2 ( 
and Re($ maA (-)). 



Cov 



(A 1 )), J Re(0 a3a4 (A 2 )) 



n n n n 



(2TT) 2 (np r , 



E E E E Kfafa - - h)) 



tl=lt2=l*3=l*4=l 



x Cov 

1 



x ai ( — ) x a2 ( — ) , X a , ( — J x a4 ( — 

VPn/ \Pn/ VPn/ \Pn 

n ?i n n 

E E E E ^fofa - t2))K(b n (t 3 - u)) 



(*2-ti)Ai 
cos l l COS 

Pn 



(*4 ~ ^3)A; 
Pn 



t 1 =lt 2 =lt 3 =lt4=l 



a 



C, 



£12 £14 



^2 ~ ^4 
Pn 



""l~C<ii as 



11121314 



tl — t4 *2 — £4 *3 — ^4 



1114 



cos 



il — 1& 



a 



(*1 - *2)A] 



12 Q3 



COS 



*2 ~*3 
Pn 

(*3 " *4)A 2 



Pn Pn Pn 

=Ti(Ai, A 2 ) + r 2 (Ai, A 2 ) + r 3 (A l5 A 2 ), 

where the three terms correspond to the three summands appearing inside square brackets in the 
previous step. 

Now consider the function Ti(Ai, A 2 ). By using the transformations u\ = t± — i 2 , u 2 = t\ — t% 
and U3 = t 2 — £4, we have 

1 n ti— n n— ti ti — n— «i 



Ti(Ai,A 2 ) 



E E E E K(b nUl )K(b n ( Ul -u 2 + u 3 )) 



(2vr) 2 (np n ) 2 ^ ^ ^ ^ 

\ ) \ rn> t 1 = lu 1 =t 1 -lu 2 =t 1 -lu 3 =t 1 -l-u 1 



x C1113 ( — I c< 



Pn 



«2«4 



U 3 



cos 



itiA] 



cos 



Qi - « 2 + ?x 3 )A 2 

Pn 



The range of the four summations on the right hand side is described by the set of inequalities 
1 < ti < n and t\ — n < u\,U2,U\ + U3 < t\ — 1, which is equivalent to the inequalities 

— (n — 1) < ui, it 2 , u\ +U3 < (ti— 1) and maxjui, u 2 , ui +U3} + 1 < t\ < min{«i, ii 2 , u\ +U3}. 
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Therefore, the expression for Ji(Ai, A2) simplifies to 
1 

(2ir) 2 np, 



! (n-l) (n-l) (n-l)-tti 

2 — 2 XT ^("l, ^2, u 3 )K(b n u 1 )K(b n (u 1 - U 2 + 1*3 )) 



n ui=— (n— 1) U2=— (n— 1) U3=— (n— 1)— ui 



X C aia3 C a2 a 4 COS COS 



Pn) \PnJ \ Pn J \ P 

where 

/ mm(ni,u 2 ,ui + n 3 ) max^j, u 2 , «i + u 3 ) 

(Ai(«l,W2,1t3) = H 

\ n n 

By writing the cosine functions in terms of complex exponentials, we have 

Ti(Ai,A 2 ) 

(n-l) (n-l) (n-l)-tti 

= u 7r \2 np 2 XT U n (u 1 ,u 2 ,u 3 )K(b n ui)K(b n (u 1 - u 2 + w 3 )) 

n Ul=— (fit— 1) M2 = — («•— 1) U3=— (n— 1)— Ul 

f U 2\ ^. f U 3\ [ i (A 1~ A 2)"1 j A 2"2 j A 2"3 ■ (A 1 -A 2 )«l ,- A 2 n2 j *2"3 

x C aia3 I — I C a2a4 I — I < e Pn e e ^ + e pn e pn e Pn 

V Pn / V Pn / L 

g (A 1 +A 2 )u 1 ; A 2 u 2 ^ A 2 M3 i (A 1 +A 2 )ni ^ A 2 M2 ; A 2"3 

+e pn e pn e pn -|- e pn e pn e pn 
= T n (Ai, A 2 ) + T 12 (Ai, A 2 ) + T 13 (Ai, A 2 ) + T 14 (Ai, A 2 ), 

(A.3) 

where the four terms correspond to the four summands appearing within braces in the last factor on 
the right hand side of (1A.3I) . 

By using the results of Lemmas 1 and 2 given below, we have the convergence 



1 



00 



Ura4Tii(Ai, A 2 ) = - I y if (x)cte J (/> aia3 (A 2 )^* 2a4 (A 2 )l £ ; 2U£ ; 4 (Ai, A 2 ) 
and similar arguments show that 

^im ) nfe n r 12 (Ai,A 2 ) = I (/ ^ 2 ( x ) d:r ) ( A 2)<Aa 2 a 4 (A 2 )l£ 2 u£ 4 (^i,A 2 ), 

^irr^n&„T 13 (Ai,A 2 ) = ^fj K 2 (x)dx S j <p aia3 (X 2 )(f>* a2a4 (X2)lE 3 uE i (^i^2) and 

lim n6 ri ,Ti 4 (Ai,A 2 ) = 7 (/ K 2 {x)dx J 0* ia _(A 2 )<£ a2a4 (A 2 )lE 3U E 4 (Ai, A 2 ). 

n^oo 4 VJ-00 / 

For the function T 2 (Ai, A 2 ), one can similarly use the transformations u\ = t\ — t 2 , u 2 = t\ — t& 
and u 3 = t 2 — t 3 , interchange the order of summation and expand the cosine functions in terms of 
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complex exponentials to obtain 

T 2 (Ai,A 2 ) 

(n-l) (n-1) (n-l)-ui 

2 — 2 XT U n (ui,u 2 , u 3 )K(b n u 1 )K(b n (-u 1 + ii 2 - u 3 )) 



(27r) 2 n/9 2 

n ui=— (n— 1) «2=— (n— 1) «3=— (re— 1)— ui 



u 2 \ ( u A cn J u ^ \ ro „ f + ^ - n 3 )A 2 

( ~ / <J2a3 I cos I CO 

PnJ \PnJ V Pn J 

(n-l) (n-l) (n-l)-ui 



= 7^2 2 X] L^i,U 2 ,U 3 )lf(&„Ui).FC(6„(-Ui + U 2 - U 3 )) 

^ n u\=— (n— 1) «2=— (n— 1) «3=— (n— 1)— «i 

( U 2 \ / li 3 \ f „ ; ( A 1- A 2)"1 j A 2"2 j A 2"3 j ( A l~ A 2)"l j A 2"2 j A 2"3 

x C aia4 I — 1 C a2a3 I — 1 je e pu e p n + e pn e p« e pn 

j (Ai+A 2 )ui j A 2 «2 £ A 2"3 ^ (A 1 +A 2 )ui , ; A 2 U2 ; *2"3 'l 

p»> e en e pn + e pn e pn e pn /• 

= T 21 (Ai, A 2 ) + T 22 (Ai, A 2 ) + T 23 (Ai, A 2 ) + T 24 (Ai, A 2 ). 
By using similar arguments as in the case of nb n T\\ (Ai, A 2 ), it can be shown that 

nb n T 21 (\ 1 , A 2 ) = ^ fy ^ 2 (^)daA aici4 (A 2 )</> a2a3 (A 2 )li<; 2 u_B4 (Ai , A 2 ), 
nb n T 22 (\i, A 2 ) = i ^ i^ 2 (x)dx^ (/>* ia4 (A 2 )0 a2a3 (A 2 )li7; 2UjB4 (Ai, A 2 ), 
n6„T 23 (Ai, A 2 ) = \(J K 2 (x)dx S j ^ aia4 (A 2 )0* 2a3 (A 2 )l B3 uE 4 (Ai, A 2 ) and 

n6nT24(Ai, A 2 ) = K 2 {x)dx^j c/)* aia4 {X 2 )(t) a2a3 {X 2 )lE 3 uE 4 ( x i: A 2)- 

Finally, for the term T 3 (Ai, A 2 ), we use the transformations ui = ti — £4, u 2 = t 2 — t± and 
""3 = *3 — *4 an d interchange the order of summations to have 

(n-l) n-l (n-l) 

/ 9 \ 2 / \ 2 ( n mm ( tl i' u 2, U3) + max(ni, u 2 , u 3 )) 



(2ir) 2 (no ) 2 

y 7 v ra > ui=-{n-l) tt 2 =-(n-l) u 3 =-(n-l) 



A(&n(«l - U 2 ))K(b n U 3 )C aia2a3a4 — , — , — COS COS 

VPn Pn PnJ \ Pn J 



\2 



Pn 



From Assumptions 2 and 5, we have 

n— 1 n— 1 n— 1 



n— 1 n — 1 yt — ± ^ \ ^ 

n6n|T 3 (Ai,A 2 )| < Pn&nM 2 9aA — )gaA - 

„. - i„ i\ „. _ /•„ tv .. _ /•„ i\ VPn/ \/ 



9a 3 



3 



, / \ I'll J \ I'n J Pn 

u\=— (n— 1) U2=— (n— 1) U2=— (n— 1) 

(A.4) 



Now consider the function S^-) defined over M as 



n-l 

■ Ul 



S n { x ) — y ] 9a! ( ) l/ "!- 1 "1 1 

/ \PnJ K Pn 'Pn> 

«i=— (n— 1) 



16 



Observe that lim n _*.oo S n (x) = g ai (x) and | jS>» (a?) | is dominated by g ai (-)- By applying DCT, we 
have ^ 

lim / S n (x)dx = lim V" g ai ( — ) — = / g a {x)dx. 
n ^°°J-oo n ^°° 7 .> \PnJ Pn J-oo 

Ul=— (n— 1) 

Thus, the upper bound of nh n T3(Ai, A2) given by (IA.4b is 0(p n b n ). Assumption ?? ensures that 
nb n T3(Ai, A2) converges to zero uniformly. 

By combining all these terms, we have the convergence of nb n Cov Re(4> aia2 (\i)), Re(4> a3ai (A2)) 
as given in the theorem. Convergence of the other three covariances follow from a similar argument. 

□ 

Lemma 1. For Ai — A2 = 0, the function Tn(Ai, A2) converges as follows. 



1 



oc 



Jjm j n6 n r 1 i(Ai,A 2 ) = ^[ j K 2 (x)dx ) 0aia 3 (A2)$l 2a4 (A 2 j 



77ie convergence is uniform on any compact subset of the set 

E = {(Ai, A 2 ) : Ai - A 2 = 0, - 00 < Ai, A 2 < 00}. 



Proof of Lemma 1 . Consider a compact subset E' of the set E. Consider the simple function 
S n (-), defined over E' x M 3 by 

5 n (Ai, \ 2 ,xi,x 2 ,x 3 ) 

(n-l) (n-1) (n-l)-ui 

= ^ ^ t/„(ni,U2,n 3 )K(6 n ui)X(6 n (ui - u 2 + u 3 )) 

m=— (n— 1) U2=— (fi— 1) «3=— (n— 1)— «i 

x C„,„. a — e c» C, 



So that 

1 

(4V) 2 



«l«:t \ ~ J ' ' k "2"l \ ~ I e 1 ((m-l)bn.mbn')]( X l) 1 / ("2-l) "2 1 ( X 2)l/ (^ 3 -l) na]^)- 



oo /-oo />oo 



OO J — OO J — oo 



nb n ru(Ai, A 2 ) = f4 _, 2 I I I S n (X 1 ,X 2 ,x 1 ,x 2 ,x 3 )dxidx 2 dx 3 . 



p n x 2 and p n x 3 , respectively. Thus, {xi,x 2 ,x 3 ) G (6 n ui n _i(xi), 



Define ui n (xi), u 2n (x 2 ) and U3 n (^3) as the smallest integers greater than or equal to x\/b n , 

U2n-\(X2) U2„(X2) 

"2n(^2) , U 3n (x 3 ) 
Pn ^ X 2, pn 

and 6 n /9 n — )• as n — > oo, we have, for any point {x\, x 2 ,x 3 ) G K 3 and large enough n, the in 

b n -Xl , , Wfcn- 

fcnPn 3 6nP. 



M3n-l(^3) Mgn^a) 
Pn ' Pn 



and bnUinfxi) — >x±, U2n(X2 > -^x 2 , U3n } X3 > -+x 3 as n — > oo. Since n&„ — >• oo 

x / Pn Pn 



equalities - nb , n Xl < x 3 < nb b n a Xl , i.e., -n + 1 - ui n {xi) < u 3n {x 3 ) < n - 1 - ui„(xi). Thus, 
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for sufficiently large n, we have 

£Vt(Ai, A 2 ,xi,x 2 ,x 3 ) 

= U n (u ln (xi),u 2 n(x2),u 3n (x 3 ))K(b n u ln (x 1 ))K(b n (u ln (x 1 ) - u 2n (x 2 ) + u 3n (x 3 ))) ( A 5 ) 

~ (u 2n {x2)\ -j !!MM^ „ ( U 3n (x 3 )\ j "3n(*3)*2 

Observe that, under Assumptions 1,3 and 4, the function 5 n (Ai, A 2 , x\,x 2 , x 3 ) converges to the 
function S(-), defined over E' x M 3 by 

S(Xx, \2,xx,x 2 ,x 3 ) = K 2 ( Xl )C aia:i (x 2 ) e- lx ^C a2ai (x 3 ) e lx ^ . 

Observe also that S(X\, A 2 , x\, x 2 , x 3 )dxidx2dx 3 is acontinuous function in (Ai, A 2 ). 

As in the proof of Theorem 1 , we prove the convergence of the left hand side of (IA.5b uniformly on 
E', by showing that for any sequence (Ai n , A 2n ) — > (Ai, A 2 ), 

/•oo poo roo 

n— >oo 



lim ill S n (\i n ,\2n,Xl,X2,X 3 )dxidx2dx 3 

S(X\, A 2 , x\, X2, x 3 )dx\dx2dx 3 . 



oo J — oo J —oo 

■OO POO poo 



oo J —oo J —oo 



for (Ai n , A 2n ), (Ai, A 2 ) G E'. The latter convergence follows, through Assumption 1 and 2 and the 
DCT, from the dominance 

\S n (Xi n , X 2n ,xi,X2,x 3 )\ < MKi(xi)g aia3 (x 2 ) 

and the convergence of the integrand, which holds because of the continuity of C aiaz {-), C a2ai {-) 
and the kernel and the exponential functions. Hence, nb n T\i{-) converges as stated uniformly on 
the compact set E' . □ 

Lemma 2. For X\ — A 2 ^ 0, the function nb n Tn(Xi, A 2 ) converges to zero. The convergence 
is uniform on any compact subset of the set E\ given by 

E = {(Ai, A 2 ) : Ai - A 2 ^ 0, - oo < Ai, A 2 < oo}. 



Proof of Lemma 2. Let E' be any compact subset of the set E. Consider the simple function 
5„(-), defined over E' x M 3 by 

S n (Xl,X 2 ,Xl,X2,X 3 ) 

(n-l) (n-1) (n-l)-U! 

= 2^ 2^ 2^ U n (u 1 ,u 2 ,u 3 )K(b n u 1 )K(b n (ui - u 2 + u 3 ))e~ l ^ 

u\=— (n— 1) U2=— (n— 1) U3=— (n— 1)— u\ 

(u 2 \ _jH2^2„ (u 3 \ ,23*2 
X C aia3 — e Pn C a2a4 — \b Pn l(( u , -l)b n , m b n )](Xl)l ( (u 2 -l) ^ 1 (x 2 ) 1 / u^[x 3 ). 

\Pn J \Pn / V Pn ' Pn J V Pn ' Pn J 
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So that 



ra6 n Tii(Ai, A 2 ) 



1 



oo roc />oo 



oo J — oo J — oo 



S n {X\, A 2 , xi, X2, x 3 )dxidx2dx3. 



An argument similar to that used in the proof of Lemma 1 shows that for (x\, x 2 , x 3 ) E M 3 and 
sufficiently large n, 

S n (Xi, A 2 ,xi,x 2 ,x 3 ) 

= U n (ui n (xi) , U 2n (x2) , U3 n (x3))K (b n Ul n (xi))K (b n (ui n (xi) - U 2n (x 2 ) +U3n(^3))) 



x e 



; "ln( 3: l)( A l-- > '2) /^■2n(2 ; 2) N \ £ "2nQ 2 ) A 2 



c a 



1 e P« 



Pn / \ Pn 

where ui n (x\), u 2n (x 2 ) and U3 n (x3) are the smallest integers greater than or equal to x\/b n , p n X2 
and p n X3, respectively. 

For obtaining the uniform convergence of nb n Tn(Xi, A 2 ), consider 



sup 

(Ai,A 2 )e-& 



oo poo roc 



— oo J — oo J — oo 

/oo poo poo 
/ / 
_ , ..... -oo J oo J-oo 

/OO f'OQ f'OO 
/ / 
-OO J —CO J — CO 



S n {X\ , A 2 , xi , x 2 , x 3 )dxidx2dx3 

S n (Xi, A 2 ,xi,x 2 ,x 3 ) - g n {Xi, A 2 ,xi,x 2 ,x 3 )|dxidx 2 dx 3 



gn(Xi,X 2 ,xi,X2,x 3 )dxidx 2 dx3 



(A.6) 



where the function g n (-) is defined over E' x M 3 by 



5n (Ai,A 2 ,xi,x 2 ,x 3 ) = K 2 { Xl )e- %Xl( ^y C aia3 (x 2 ) e~ ix ^C a2aA (x 3 )e ix ^. 



We will show the uniform convergence of the right hand side of dA.61 ) by considering the two terms 
separately. For the first term, we follow the route taken in the proof of Theorem 1, i.e., show that 
for any sequence (A in , A 2n ) -)• (Ai, A 2 ), 



oo rco rco 



OO fOO fOO 



lira / / |5 n (Ai n , A 2n ,xi,x 2 ,x 3 ) - 5t n (Ai„, A 2n ,xi,x 2 ,x 3 )|dxi(ix 2 (ix3 = 

n ^°° J-oo J-oo J-oo 

for (Ai n , A 2n ), (Ai, A 2 ) G .E'. For this purpose, we write the above integral as 

\S n (Xl n , A 2n , XI, X2, X 3 ) - 5f n (Aln, A 2n , X\ , X 2 , X3) |dxie?x 2 dx3 

— 00 J —00 J —00 

/oo poo poo 
/ / \S n (X ln , A 2n ,xi,x 2 ,x 3 ) - G n (X ln , X 2 n,xi,X2,x 3 )\dx 1 dx 2 dx 3 
-00 J — 00 J —00 

/OO /*00 /"OO 
/ / |G n (Ai„, A 2n ,xi,x 2 ,x 3 ) - g n (Xi n ,X 2n ,x 1 ,x 2 ,x 3 )\dxidx 2 dx 3 , (A.7) 
-00 J —00 J —00 



where the function G n {-) is defined over E' x M 3 by 

;"ln( 3: l)'"i( A l- A 2) 



G n (Ai,A 2 ,xi,x 2 ,x 3 ) = iC 2 (xi)e 1 """»»"»' "C aia3 (x 2 )e " 2A2 C a2 a 4 (x 3 ) e 
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Now observe that 



\S n (\l n ,\2n,%l, X 2 ,X3) ~ G n (A in , A 2n , Xl, X 2 , X 3 )\ 

.■ °ln( J: l) 1 '"( A ln" A 2n) 



< M 



an(Aln, A 2n ,Xi,X 2 ,X 3 ) 



where 



an(A in , A 2n ,Xi,X 2 ,X 3 ) 

= U n (u ln (x 1 ),U2n(x2),U3 n (x 3 ))K(b n u ln (xi))K(b n (u ln (xi) - u 2n (x 2 ) + u 3n (x 3 ))) 



x Cai 



a-.i 



1t 2n (x 2 )\ j u 2n(*2)*2n 



U3n(x 3 )\ j"3n(*3)*2n 

1 e Pn 



Pn J V Pn 

- K\ Xl )C aia3 (x 2 ) e- ix ^"C a2a4 (x 3 ) e ix ^. 
Since a n (\ n , x, t,t') — > as n — > oo, we have 



lim |5 n (Ai„, A 2n ,a;i, ^2,^3) - G n (Ai n , A 2n , xi, x 2 , x 3 )| = 

n— >oo 

Since from Assumption 1 and 2, we have the dominance 

\S n (Xi n , A 2n ,xi,x 2 ,x 3 ) - G n (A in , A 2n ,xi,x 2 ,x 3 )| < 2M^i(xi)5 aia3 (x 2 )s[ a2a4 (x 2 ). 
By applying the DCT, we have 

/"OO /"OO /"OO 

lim / / / |S" n (Ai n , A 2n ,xi,x 2 ,x 3 ) - G n (Ai„, A 2n ,xi,x 2 ,x 3 )|(ixidx 2 (ix3 = 0. 



00 J —00 J —00 



Turning to the second term on the right hand side of (IA.7I ). observe that for any fixed x\, 



i u ln (x 1 )b n (\ ln -\ 2 n) 
g bnPn 



j x l( A ln- A 2n) 
g bnPn 



< 



Aln — A 



2n 



Thus, 

|G n (Ai„, A 2n ,Xi,X 2 ,X 3 ) - 5n(Aln, A 2n ,Xi,X 2 ,X 3 )| 
<M 2 g (0)9 0,20,4, (0) 
and so 



£ "lreOl) t, n(A ln -A 2n ) ^ gl (A ln - A 2n ) 

g bnPn — g bnPn 



<^-.(0)pa.«(0)^— ^, 



lim |G n (Ai n , A 2n ,xi,x 2 ,x 3 ) - g„(A in , A 2n , xi, x 2 , x 3 )| = 0. 

n— >oo 

From Assumption 1 and 2, we have the dominance 



\G n (\x n , A 2n ,Xi,X 2 ,X 3 ) -5n(Aln,A 2n ,Xi,X 2 ,X 3 )| < 2M^i (Xi )5aia 3 (^2)^204 (^2) • 
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which leads us, through another use of the DCT, to the convergence of the second integral of (IA.7b . 
This establishes that the first term on the right hand side of (1A.6I ) converges to 0. We only have to 
deal with the second term. Let 



oo />oo />oo 



Sn(Ai,A 2 )=/ / / g n (\ 1 ,\ 2 ,xi,X2,x 3 )dx 1 dx 2 dx 3 . 

J —oo J — oo J —oo 

In order to establish the uniform convergence of s n (-) over E' , it is enough to show that s n (Ai n , A 2n ) 
for any sequence (Ai n , \2n) — > (Ai, A2), where (Ai n , \2n), (Ai, A2) G E' . By using the Reimann- 
Lebesgue lemma, we have s n (Ai, A2) — > 0. Thus, the second term on the right hand side of (|A.6b 
also converges to 0. Hence, nb n Tn(Xi, A2) converges to uniformly on E' as n — > 00. □ 

Proof of Theorem 3. cum($ aia2 (Xi),$ a3ai (\ 2 ), . . . ,?a 2i _ia 2i (Az)) can be written as 

cnm(0 aia2 (Ai),^ a3a4 (A 2 ), . . . Aa 2L . ia2L {^L)) 

n n n n 

= 7^lEE- E E K(b n (t 1 -t 2 ))...K(b n (t2L-i-t 2 L))e 

K ' ' *1 =1*2=1 t 2L _ 1 = lt 2L = l 



i(t 1 -t 2 )X 1 

pn X 



_*(hL-l-t2L»L f tl \ (t 2 \ v (t 2 L-l\ v ft 2 L 

x e pn cum [X ai [ — ) X a2 [ — ) X a2L _ x X a2L 



Pn) \Pn) \ Pn ) \ P 



(A.8) 



It follows that 

|cnm(^ aia2 (Ai),^ a3a4 (A 2 ), . . . , ^a 2L _ ia2L (XL))\ 



^ ttttl EE- E E - M) • • • K(MhL-i - t2 L ))\ 

y n P") tl =it 2 =i t 2L _ 1= it 2L =i 

cum [X ai ( -± ) X a2 (-2- J ,...,X a2L _ 1 ( -^=1 J X a2i ( 

V \Pn) \Pn ) \ Pn ) \ Pn 



Now 



Xai < Xa2 (£)"•" Xa2i - 1 (^r) Xa2i (S 1 



/ > a in a ii2--- a iifc 1 
V 



X C/i ■ n • n ■ 

u JPl u 3P 2 --- u 3Pk, 



Pn ' ' Pn 



P 



Pn / 

where the summation is over all indecomposable (Brillinger, 2001; Leonov and Shiryayev, 1959) 
partitions u = (ui, . . . , up), such that v v = (j p i, . . . ,j p k p ), P = 1, . . . ,P, of the table 

1 2 
3 4 

2L-1 2L 
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and t' p = tj pkp , p = 1 , . . . , P. Since the partition u is indecomposable, we have 

h P i ~ t 'pi z *2m - t 2m -i] I = 1, . . . , k p ; p = 1, . . . , P; m = l,...,L. 

Define 

u j P i = tjpi ~tpi I = 1, ■ ■ ■ ,k p ;p = 1, . . . ,P. 

Note that Uj pkp = for p = 1,...,P. Then the joint cumulant of (4> ai a 2 (^i)> 4>a 3 a 4 (^2), ■ • •> 
4>a 2L - 1 a 2L (-Vl)) given by dA.8b is absolutely bounded by 

^ n n—t^ n—t^ n n—t' p n—t' p 

^ «i=i %11 =-(ti-i) ^^=-(4-1) t' P =i%> 1 =-(t' P -i) «yp,* p _i=-(*P-i) 
\K[b n (ui + - u 2 - ip 2 )]| • • • lif [6 n (n 2 i-i + 4l-i ~ u 2 l - t' P2L )} 

(A.9) 

where p m is that member of the set {1, 2, . . . , P} which satisfies t m £ f Pm for m = 1, . . . , L. 

We will now show that the set A = {t' pi — t'..., t' p2L _ 1 — t' p2L } has P — 1 linearly independent 
elements. Note that the set A consists of differences of pairs of elements of the set {t^, t' 2 , . . . , t'p}. 
So the set A can have at most P — 1 linearly independent differences. Suppose that the set A has 
exactly P — j linearly independent differences for some j > 1. Denote the P — j independent 
differences of the set A by 

A — { f' _ f' f' _+< f' _ f' \ 

where fei, . . . , &p_j £ {1, 2, . . . , L}. Let, if possible, j > 1, and consider a difference — for 
^1,^2 £ {1,2, ... ,P} which is linearly independent of the elements of the set A\ . Since the partition 
v is indecomposable, the sets vi x and ui 2 communicate (Leonov and Shiryayev, 1959). Therefore, 
there exists an index set {s\, s 2 , ■ ■ ■ , s r } with r > 2, which is a proper subset of {1,2,..., P}, 
such that s\ = li, s r = l 2 and the pairs (z/ ai , i/ S2 ), (za^, i/ S3 ), . . . , (^ Sr ._i, *v) are hook (Leonov 
and Shiryayev, 1959). Consequently, there exist indices ji, . . . , j r -i £ {1, ■ ■ ■ ,L} such that for 
m = 1, . . . , r — 1, one of the points t 2 j m -\ and t 2 j m belongs to v Sm and the other belongs to v Sm+1 - 
It follows that for m = 1, . . . , r — 1, (i' . — i' . ) is in A, and hence, they can be written as 
linear combinations of the members of A\. Note that for m = 1, . . . , r — 1, _ 1 — 4J is equal 
to either - i^.J or -(^.^ - ^.J. Thus, 

4 - 4 = 4 - 4 = (4, - f S2 ) + (4 - 4) + • • • + (4_ x - 4) 
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can be written as a linear combination of the members of A\. This fact contradicts the assumption 
that tj — t' l2 is linearly independent of the elements of the set A\. Therefore, j cannot be larger than 
1. This proves that the set A cannot contain fewer than P — 1 linearly independent differences. 
Consider the P — 1 linearly independent elements of the set A\, where j = 1, and define 

vi = u 2fel _i + t' p2ki l - u 2kl - t' p2ki , 

VP-l = U 2kp _ 1 -1 + 4^.!-! - U ^P-1 - ^ 2hp _ 1 • 

Using the above transformation, and by replacing the P sums over indices , . . . , t' P by P — 1 sums 
overs the indices v±, . . . , i>p_i, we find that the joint cumulant given in (|A.9b is bounded from above 
by 

n—l n— 1 n— 1 n— 1 



' V E»'' " ; E ■■■ E E E 

n u «m =-("-1) u Ji,fc 1 -i=-( T1-1 ) Wjpi =-("-!) "jp.jbp-i^C" -1 ) 

3n 3n 

£ ... £ 1^(^)1... lifCMp-i)! 

?^i=— 3n i)p_i=— 3n 



a in a ii2--- a J'ife 1 



Pn ' Pr, 



c 



^JP.fcp-l 



Pn 



(A. 10) 



The above simplification has been made by taking into account the upper bound for L — P + 1 
copies of K(-) and conservative estimates of the ranges of summation of v%, . . . , vp-i. Now one 
can rewrite the expression in dA.lOb as follows. 



L-P+l {Pnb n ) L P 



3n 



K(b n vi)b r , 

Vi=—3n 



3ii 



vp—i=—3n 



X < 



n-1 



n-1 



E ■■■ E 

%ii =-(n-l) u^ fci _ 1 =-(n-l) 



Ca , , , a 



311 J12 •••"Jifc, 



Pn 



Pn 



fci-1 
Pn 



X < 



n-1 



n-1 



E - E 

u j>i=-( n -i) "jp.fep-^-^^ 1 ) 



a 



a jpi a 3P2 ■■■ a ipkp 



u 



JP,k p -l 



'JP1 Jt-,Kp- 
•)••••} 



Pn 



Pn 



kp-l 
Pn 



(A. 11) 



Consider the simple function S n {-) defined over M by 

3n 

Sn( x ) = Yl K ( b n v l) 1 (b n v 1 -l,b n v 1 ]{x). 
v\=—3n 
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Note that S n (x)dx = J2v™=-3n K{b n vi)b n , and from Assumption 2 we have the dominance 
S n {x) < K\(x). By applying the DCT, we have 



^ n /*oo 

J2 K{b n v x )b n ^ / \K{x)\dx. 

— Q„ J— CO 



v\=— 3n 

This fact establishes the convergence of the sums over v\, ■ ■ ■ , vp-\. 
Consider the simple function T n (-) defined over by 

n— 1 n— 1 



T n (xi,x 2 , . . . ,X kl -l) 



E - E f. 



u ji,k 1 -i 



a jll a h2— a hki \ n n 
1 V Hn Pn 



X 1 



Pn Pn 



(xi) . . . l r3l ti . r i " 3 -i, fcl _il 0**i-i)- 



Note that 



T n (xi, . . . ,x kl -i)dxi . . . dx kl -i 



oo J —oo 
n-1 



n-1 



E - E 



u 



u ; 



f~t | -J 11 '3l,k 1 -l 

"•ii"'!.!-"".:. . [ n ' ■ ■ ■ ' „ 



Jn-1 ' 



From Assumption 5 A, we have that the function T n (-) is bounded by an integrable function. Thus, 
by applying the DCT, we have 

n— 1 n— 1 



Hm y ... y 

n— >oo ^ — ' ' 

Wjill =-(»»- 1) "Jl.fc!-!^^ -1 ) 



1 v pn H 



Ju 



U 



'Jl.fej-l 



1 



Jfcl-1 



OO t/ — oo 



C, 



aiiiOm-^'ife • • • > x fci-i) dx i • • • dx kl -i- 



Likewise, we have the convergence for the remaining P — 1 sets of summations. Using these above 
convergence results, the upper bound of dA.91 ) given in (IA. lib can be written as 



E 

v 



(Pnbn 



\L-P 



{nb n ) L 



—d v , 



where du are appropriate constants. The summation is over the finite number of indecomposable 
partitions, and the worst-case value of the partition size P is L. Therefore, the upper bound is 
O ((n6 n ) - ( L-1 )) . This Completes the proof of Theorem 3. □ 

Proof of Theorem 4. Note that the first moment of the random vector on the left hand side 
of (0) is zero and the second moment converges in accordance with Theorem 2. Further, 



cum(c 1 (Y 1 - d 1 ),c 1 (Y 2 - d 2 ), ■ ■ -,cj(Yj - dj)) = c x c 2 ■ ■ ■ cj X cum(Y 1 ,Y 2 , . . .,Yj), 
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for any set of constants c%, . . . , cj, d\, . . . , dj. From the above fact and Theorem 3, for all k > 2, 
the absolute value of the kth order joint cumulant of the random vector on the left hand side of (f5]) is 
bounded from above by an 0((nb n ) k / 2 ~ k+1 ) term. According to Assumption 3, this upper bound 
tends to as n tends to infinity. This completes the proof. □ 

Proof of Theorem 5. The result can be proved along the lines of the proof of Theorem 3 of 
Srivastava and Sengupta (2010). □ 

Proof of Theorem 6. The weak convergence of the first term on the right hand side of © 
follows from Theorem 4. On the other hand, the second term can be written, in view of Theorem 5, 

as 

(^[^aioa (Ai)] - ttl a 2 (Ai)) = V^K. (o (( Pn b n y) + 0^+0 . (A.12) 



Under Assumption 3, 



lim \J nb n p q n b q n = lim \J nb n — = 0. 

n— »oo n— >oo n 



Therefore, under Assumptions 3 and 4A, the right hand side of dA. 12b goes to zero as n — > oo. This 
completes the proof. □ 

Proof of Theorem 7. Note that under Assumption 4A, we have 

lim \pnb~ n ^r; = (A. 13) 

n— >oo 

and 

. j_ 

lim ynbnpib^ = 44> lim (nb n ) 2 i b n p n = 

n— »oo ' n— >oo 

q 

& lim {nb n ) l+ ^ ^ = & lim ^h n ( ^ ) 1+29 = 0. (A.14) 



From (IA. 13b and (1A.14I ). we have 

1/ q 
I f Pn \ i+2 9 



'nb„ \\ n 



(A. 15) 



and^^ = o((—Y). (A.16) 



/ nbn \\Pri, 

The right hand sides of dA. 15b and dA. 16b are increasing and decreasing functions, respectively, 
of p n - Assumption 3, together with (IA. 13b . indicate that p n goes to infinity as n goes to infinity. 
The rate given by dA. 15b will be unduly slow if p n goes to infinity too slowly, while the rate given 
by (1A.16I) will be unduly slow if p n goes to infinity too fast. At either event, 1 / ^Jnb n will have a 
sub-optimal rate of convergence to zero. It follows that 1/V nb n has the fastest convergence to zero 
if 

o[(~) i Oi/O 
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This condition requires that p n = O (^nv+q+ipq ^ . For this rate of p n , (1A.15I ) implies that 



, P+Q \ 1 

b„ = oln p+i+ 2 pi and 



*nb r , 



o ( n p+i+ 2 pq 



This completes the proof. 



□ 
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